MARKOV CHAINS CONDITIONED NEVER TO WAIT TOO LONG 

AT THE ORIGIN 
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. . . Abstract. Motivated by Feller's coin-tossing problem, we consider the problem of 

0^ ' conditioning an irreducible Markov chain never to wait too long at 0. Denoting by 

, T the first time that the chain, X, waits for at least one unit of time at the origin, 

' we consider conditioning the chain on the event (t > T). We show there is a weak 

limit as T ^ cxD in the cases where cither the statespace is finite or X is transient. 
We give sufficient conditions for the existence of a weak limit in other cases and 
show that we have vague convergence to a defective limit if the time to hit zero has 
a lighter tail than r and r is subexponential. 
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^ ■ 1. Introduction and notation 



1.1. Introduction. Feller (in Section XIII. 7 of [1]) showed that if pn^ is the proba- 
bility that there is no run of heads of length k or more in n tosses of a fair coin, then, 
for a suitable positive constant Ck 



, 

(X) ■ where Sk is the largest real root in (0,1) of the equation 



1.1) x'^-^ 2^(^+1 V-i^^ = 0. 

0\ '. j=o 
O 

More generally, if the probability of a head is p = 1 — q, then the same asympotic 
^ ; formula is valid, with equation (11.11) modified to become 

H ' fe-i 

;i.2) x'^ -g^p^x*^-^-^' = 0, 

j=0 



and Cfe - 

The continuous-time analogue of this question is to seek the asymptotic behaviour of 
the probability that F , a Poisson process with rate r, has no inter-jump time exceeding 
one unit by time T. It follows, essentially from Theorem 11.21 that, denoting by ry the 
first time that Y waits to jump longer than one unit of time, 

(1.3) P(ry > t) ~ c^e"'^^*. 
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for a suitable constant c^, where 0^ = 1 if r = 1 and otherwise 0.^ is the root (other 
than r itself) of the equation 

(1.4) xe"^ = re'"". 

A natural extension is then to seek the tail behaviour of the distribution of r = rx, the 
first time that a Markov chain, X, waits longer than one unit of time at a distinguished 
state, 0. In general, there has also been much interest (see [7j, [S], [TT], [T], [2], [5], 
[6], [I2], [9], [15], [ID], [E], [I3]) in conditioning an evanescent Markov process X on 
its survival time being increasingly large and in seeing whether a weak limit exists. 

1.2. Notation. We consider a continuous-time Markov chain X on a countable state- 
space S", with a distinguished state d. We denote S \ {d} by C. For convenience, and 
without loss of generality, we assume henceforth that S = Z+ or S* = {0, . . . , n} and 
9 = so that C = N or C = {1, . . . , n}. 

We assume that X is irreducible, and non-explosive. We denote the transition semi- 
group of X by {P{t)]t > 0} and its Q-matrix hj Q = (qij) and set qi = —qu. We 
define the process X as X killed on first hitting and we shall usually assume that X 
is also irreducible on C. We denote the substochastic semigroup for X by {P{t))t>o- 
We first define the return and departure epochs as follows: 

So = inf{t > : Xt = 0}, To = inf{t > : Xt ^ 0} 

and then for n > 1: 

= inf{t >Sn: Xt^ 0}, 

and 

Sn = mf{t > Tn-i : Xt = 0}, 
then we define the successive holding and return times -ff">o and Rn>o by 

H° = To and R° = So 

and 

H"" = Tn- Sn and = S^+i - T„ for n > 1. 
Then we define the current holding time as follows: 

Ht = t — Sn a Sn < t < Tn ioT some n. 

It will be convenient in what follows to define 

ift = if Xt ^ 0. 

We denote the first time that X waits in for time 1 by r, i.e. 

T = mf{t : Ht > 1}, 

and denote the process X killed at time r by X. We denote the statespace augmented 
by the current holding time in by S* *== C U {{0} x [0, 1)}. By a slight abuse of 
notation, we denote the (substochastic) Markov chain (X^, Ht) on the statespace S 
by X alscS. The associated semigroup is denoted (-P(t))(>o. Throughout the rest 
of the paper we denote by Pj the probability on Skorokhod pathspace D{S, [0,cx))), 
conditional on Xo = i, and the corresponding filtration by {J-'t)t>o- Finally, we denote 
a typical hitting time of from state i by Tq*^ and its density by pi. We denote the 
density of a typical return time, R^, by p. 



^Note that if Xt ^ then Ht = % so {Xt,Ht) = Xf 
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1.3. Convergence/decay parameters for evanescent chains. We recall (see for 
example [9]) that, if X* is a Markov chain on C, with substochastic transition semi- 
group P* and Q- matrix Q* = {q*j)(ij)(^cxc^ then X* is said to be evanescent if it is 
irreducible and dies with probability one. In that case, we define 

/>oo 

ax*=a = inf{A > : / P*j{t)e^^dt = oo} 

Jo 

for any i,j G C, and (see, for example, Seneta and Vere- Jones [TT]) X* is classified 
as a-recurrent or a-transient depending on whether P*j{t)e°'^dt = oo or is finite. 
Moreover, X* is a-recurrent if and only if f*^{t)e°'*dt = 1, where f*^ is the defective 
density of the first return time to i (starting in i). 

In the a-recurrent case, X* is a-positive recurrent if 

POO 

/ t/;^(t)e"*rft < oo, 

otherwise X* is a-null recurrent. Defining q* = — it is easy to see that a < q* for 
alH G N and hence 

< a < inf g*. 

i 

Thus a measures the rate of decay of transition probabilities (in C). There is a second 
decay parameter — fi*, which measures the rate of dying. 

We define r* as the death time of X* and we define s*{t) = X]ji^*(t) = Pi(r* > t) 
and set 

poo 

/i* = inf{A : / s*{t)e^'dt = oo}. 
Jo 

Notice that /i* is independent of i by the usual irreducibility argument, moreover, 
since 1 > s*{t) > P*^{t) it follows that 

< /i* < a. 

Note that in our current setting, we shall take X* = X and write r* = tq, the first 
hitting time of 0. We shall denote the rate of hitting 0, which is the death rate 
for X*, by /i*" and a* by a*" and the survival probabilities for X as s*", so that 
sf(t) =P,(ro >t). 



1.4. Doob /i-transforms. Recall (see, for example. III. 49 of Williams |19j) that we 
may form the /i-transform of a substochastic Markovian semigroup on S, (P(t))(>o, 
if h : S ^ is P-superharmonic (i.e. [P{t)h]{x) < h{x) for all x G S* and for all 
t > 0). The /i-transform of P, P^, is specified by its transition kernel which is given 

by 

p\x,dy;t)''^^Pix,dy;t), 

so that if we consider the corresponding substochastic measures on path-space, P^; 
and (conditional on Xq = x) then 



(iP 1^' 



hiXt 
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and forms another substochastic Markovian semigroup. If h is actually space-time 
P-superharmonic then appropriate changes need to be made to these definitions. In 
particular, if h{x,t) = e'^^h^ then 

As shown in [9j, in general, when a weak limit or a vague limit exists for the problem 
of interest, it must be a Doob-/i-transform of the original process, with the state 
augmented by the current waiting time in state in the case we study here. 

1.5. Main results. Denoting by P{t) the substochastic transition semigroup for X, 
we define 



Si{t) = Pi(r >t)= P{i, S; t) for i G S. 



Our first result is 



Theorem 1.1. Suppose that X is transient. Denote Pj(X never hits 0) by f3i and 
define A = E,ec Set 

n dcf (l-e-'^°)A 

= = e-^o + (i_e-.o)A ' 

\ _ g-<?0(l-M) 

(1-6) P(0,n) = Po, 

and 

(1.7) pi = Pi + {l-l3i)p^forieC. 
Then 

(1.8) Siit) Pi for all i G S. 

Hence, if we condition X on t = oo we obtain a new Markov process, X°°, on S with 
honest semigroup P°° given by 

(1.9) P.^it) = ^p,it)forjeC 

Pi 

and 

(1.10) pr{{o,duy,t) = P^p,{{o,du)-t), 

Pi 

so that X°° looks like a Markov chain with Q-matrix given by = j-qij on C , whilst 
X°° has a holding time in with density d given by 

e~i'^'ds 

and a tine-homogeneous jump probability out of state to state j of 



<?0PO 



In the case where X is recurrent, it is clear that Sj(t) for each i G S. 



Now let W '= + (so that W is the first return time of X to from 0) and 
let g be the (defective) density of W1(^h^^i) on (0, oo). Our first result under these 
conditions is as follows. It is a generalisation to our more complex setting of Seneta 
and Vere- Jones' result in the a-positive case. 
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Theorem 1.2. Let 



/(A) = 



POO 

Jo 



then if 

(1.11) there exists a (p such that = 1, and ) < oo, 

then for each i E S, 

e<PKs,it)'^p,>0, 

where the function p is given by 



:i-i2) P(o,o) 

^1-13) P(o,„) = 



e'^-^O def 



' 

e('t>-io>ds 



and, for i ^ 0, 

(1.14) P^ = Fi,o{<f))K, 

where 

(1.15) F,,o(A)=Ee< = / e^ViW^^^- 

Jo 

The foUowing simple condition ensures that condition (11.111) holds. 

Lemma 1.3. Suppose that X is a-recurrent, and both Nq {i : qifi > 0} and 
Nq =^ {i : go,j > 0} are finite, then U.ll\) holds. 

Corollary 1.4. Let denote the chain on S obtained by conditioning X on the 
event {r > T), then, if condition M.ll\] holds, for each s > 0, the restriction of the 
law of X^ to Ts converges weakly as T ^ oo to that of X°° restricted to Ts, where 
the transition semigroup of X°° is given by equations U.9\) and U.10\) . 

In the case where /(0) < 1 or /'(</>—) = oo, Theorems 13.61 13.71 and [3^ (may) apply, 
giving some sufficient conditions for weak or vague convergence to take place. In 
Theorem 13.101 and Corollary 13.111 we give an application to the case of a recurrent 
birth and death process conditioned not to wait too long in state 0. 

2. Proof of the transient and a-PosiTivE cases 

To prove Theorem II. II is straightforward. 

Proof of Theorem li.il It is trivial to establish the equations 

(2.1) = A + (l-A)Po 
and 

(2.2) p^ = (^l.e-^^^)J2—P^■ 

Equations (ll.5l) - (ll.7p follow immediately. Then the conditioning result follows straight- 
forwardly □ 
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Example 2.1. We take a transient nearest-neighbour random walk with reflection at 
and with up-jump rate ofb and down-jump rate of d. Note that 1 — f3 is the minimal 
positive solution to P(t)h = h with h{0) = 1, and that 1 — (3i = (|)*. 

The main tool in the proof of Theorem 11.21 is the Renewal Theorem. 

Proof of Theorem Recall that state (0, u) denotes that the killed chain is at and 
its current holding time is u. First note that S(o,o) satisfies the renewal equation 

(2.3) S(o,o)(t) = (l - / g{u)du)l(t<i) + / g{u)du+ / g{u)s(^o,Q){t - u)du. 

Jo Jt Jo 

If we define 

/(t) = e<^*S(o,o)(t), 
it follows immediately from (12.31) that 

poo nOQ nt 

(2.4) /(t)=e**((l- / giu)du)l^t<i)+ g{u)du) + ~g{u) f {t - u)du, 

Jo Jt Jo 

where g{t) '= e'^*g{t). Now, it is easy to check that the conditions of Feller's alterna- 
tive formulation of the Renewal Theorem (see XI. 1 of [5], p. 363) are satisfied, so we 
conclude that 

POO 

t-*(^ -1 / 6t/ 



(2.5) f{t)'^fi-' e^\{l- g{u)du)^^,))+ j g{u)du)dt, 

Jo Jo 

where 

/•oo 

/i = / tg{t)dt = /'(0-). 



It is trivial to establish, by changing the order of integration, that 



oo 



Jo Jo 





and hence (11.121) follows. 

To establish fll.l4p . notice that (by conditioning on the time of the first hit of 0), 

poo pt 

Si{t)= / pi{u)du+ / pi{u)s(^o^o){t-u)du, 
Jt Jo 

and so, denoting e'^^Siit) by fi(t), we obtain 

/•oo l*t 

fi{t) = e^^ I pi{u)du+ I pi{u)f{t-u)du, 



where pi{t) =^ e'^^pi{t). Now / is continuous and converges to n so, by the Dominated 
Convergence Theorem, 



Pi{u)f{t - u)du *^ / Kpi{u)du = K,Fifi{(f)). 
Jo 

Moreover, since Fifi{(f)) = pi{u)du < oo, it follows that e**^* pi{u)du < j"^ pi{u)du 
0, and hence 



/,(t)*-=^«:F,o(0) 



as required. 
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To establish fll.lSp . observe that 

pt p{l—u)/\v 

S{o,u){t) = e~'"'^l(t<i-u) + I I qoe~'"''" p{w - v)s(ofl){t - w)dvdw 



^0 



and hence 

def 



fio,u){t) "=^* e<^*S(o,.)(t) = e('^-'?°)*l(t<i_„)+ / / qoe^^-''^'>p{w-v)f{t-w)dvdw, 



' w=0 J v=0 

and hence, by the Dominated Convergence Theorem, 

/(o.„)(t) Kj^ C^'--\,e^'i'-^^>~p{w-v)dv 

as required □ 

Remark 2.2. Note that the case mentioned in the introduction, where Y is a Poisson(r) 
process and we let Ty be the first time that an interjump time is one or larger, can be 
addressed using the proof of Theorem \l.S[ In this case, if we consider that the chain 
"returns directly to 0" at each jump time Y then 

/(A) = f re(^-^')*rft. 



and so satisfies r^^^^ = 1 which establishes and 

^ ^ r(0-l)' 
for r 7^ 1. The case r = 1 gives = 1 and ci = 2. 

Now we give the 

Proof of Lemma \1.3\ It follows from Theorem 3.3.2 of (TU] that if Nq is finite then 
a'-' = p^ . Now since X is a-recurrent it follows that 

/ e^^Pii{t)dt < cx) iff A < a^. 
Jo 

Since sf (t) > Puit), it follows that 

/ e^^sf{t)dt = oo if A > a^. 
Jo 

Conversely, since a*^ = /x*" we see that 



poo 

/ e^Ksf\t)dt < oo if A < a' 
Jo 



c 

1 



oo 



and so we conclude that 

j e^'si{t)dt < oo iff A < a 
Jo 

Now 

/(A): 



re^'g{t)dt= /'e(^-^°)*rft(5^go.F.o(A)) = f e^'-'^^'dt{Y, 
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Now Fifi{X) < oo if and only if A < a*" and so, since is finite by assumption, 
/(A) < oo iff A < a*". It now follows trivially that < a*" and that (11.111) is satisfied 

□ 

Now we give the 

Proof of Corollary \1.4\ This follows immediately from Theorem 11.21 and Theorem 4.1.1 



of [9] provided that we can show that h, given by h : {i,t) i-^ e'^^pi, is P-harmonic. 
This is easy to check by considering the chain at the epochs when it leaves and returns 
to 0, i.e. we show that, defining a as the first exit time from 0, K(^o^u)h{XtAa,t Aa) = 

h{{0,u),0) and Kih^XtAro^t A ^o) = h{i,0) for i E C. This is sufficient since X is 
non-explosive □ 

3. The o-transient case 

We seek now to consider the a-transient case. In particular, we shall focus on the 
case where = 0. This is not so specific as one might think since one can (at the cost 
of a slight extra difficulty) reduce the general case to that where = 0. 

3.1. Reducing to the case where = 0. We discuss briefly how to transform the 
problem to this case. 

The essential technique is to note that if, for any A < 0, we /i-transform P using the 
space-time P-superharmonic function given by 

h^{i,t) = Pi,o(A)e^* for i G C 

and 

h\{0,u),t) = (1 - /(A)^^3^)e-(^-'?")V* for u G [0, 1), 

where 



JO 

then we obtain a new chain X on S, with 0^ = — A and satisfying g^^it) = e^^g{t), 
which dies only from state (0, 1—). 

Proof. It is a standard result that is space-time harmonic for P off {0} x [0, 1), 
while, since /(A) < 1, it is easy to see that h'^ is superharmonic on {0} x [0, 1), by 
conditioning on the time of first exit from 0. Now it is easy to check that X dies 
only from state (0, 1—) and dies on a visit to with probability 1 — /(A) so the result 
follows immediately. □ 

Remark 3.1. Note that, in the a-null-recurrent case, where I{(f)) = 1 but = 
oo, the transform above produces a null-recurrent h-transform when A = 0, whereas 
the transform is still evanescent in the a-transient case. 

It will follow from L'HopitaVs Theorem in the a-transient cases that ifipi denotes the 
density (on (l,oo)) ofr when starting from state i, then, if ^^^^^"^"^ has a limit ast oo 

then It IS the common limit of = ^fl'^^t f ^^f^^ = ret^t>)'^ 

In the a-null recurrent case, we see that this is not of much help. It is not hard to 
generalise Lemma 3.3.3 of [ISJ to prove that in this case {i, t) ^ e**/if is the unique 
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P -superharmonic function of the form e^^ki and so gives the only possible weak or 
vague limit. 

3.2. Heavy and subexponential tails. All the results quoted in this subsection, 
apart from the last, are taken from Sigman [18]. 

Recall first that a random variable (normally taking values in M"*") Z, with distribution 
function F^, is said to be heavy-tailed, or to have a heavy tail, if 

F^it + S) t^oo 



Fzit) 



1 for all s > 0, 



where =^ 1 — Fz, is the complementary distribution function. 

Denoting the n-fold convolution of Fz by F^, Z is said to have a subexponential tail, 
or just to be subexponential, if 

(3.1) 3^^*^^foralln, 
^ ' Fzit) 

and (O) holds iff 

(3.2) limsup — < n for some n > 2. 

t-*oo Fz{t) 

A subexponential random variable always has a heavy tail. 

Two random variables, X and Y , are said to have comparable tails, or to be tail 
equivalent, if 

JV(t) ~ cF^{t) 

for some c > 0. 

Y is said to have a lighter tail than X if 

Frit) t^oc Q 

Lemma 3.2. If X and Y are independent, Y is lighter tailed than X and X has a 
subexponential tail then X -\-Y has a subexponential tail and 



Fx+Y{t) ~ Fx{t). 

Lemma 3.3. If X and Y are independent and subexponential and tail- equivalent with 

FV{t) ~ cF^it), 

then X -\-Y is subexponential and 



Fx+vit) ~ {l + c)Fx{t). 
This generalises to the following random case: 

Lemma 3.4. Suppose that Xi, . . . are iid with common d.f F which is subexponential 
and N is an independent geometric random variable, then if 

N 

1 



then S is subexponential and 

F^{t) ~ {EN)F^{t). 
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Finally, we have the following 

Lemma 3.5. Suppose that Xi, . . . are independent and tail- equivalent with 

Fx. = F„ 

and J is an independent random variable taking values in N. Let 

Y = Xj, 

(so that Y is a mixture of the Xis) and denote its distribution function by F (so 

m = E^eNnJ = ^)m))■ 

Now suppose that 

Tiit) ~ a.'Fiit) : 
if the collection {^^] t > 0} zs uniformly integrable then, 

(3.3) F{t) ~ {Eaj)Ti{t). 

In particular, if J is a bounded r.v. then 1^3. 3\} holds. 

Proof. It follows from the assumptions that 

Fj(t) t^oo 

= > aj a.s. 

Thus if the collection is u.i. then convergence is also in L} and so, since 'KFj{t) = F{t), 
we see that _ 

Fit) t^oo 



Flit) 

In particular, if J < n a.s. then 



Eaj. 



hmsup = — < max a, a.s., 

t^oo Flit) ^<i<n 

and so the collection is indeed u.i. □ 
3.3. Results for heavy tails. Suppose first that = < fi'-' . 



Theorem 3.6. //O = < /i*-^ and r is subexponential, then ^''''K.f^ — ^ 1 for all v > 



and S(o,n)(t - t;)/s(o,o)(t) 



^ l-e-10 • 



Proof. Notice first that, since fi^ > 0, Pj(ro > t) < k^e ^'^^/^^ go that r^f' has a lighter 
tail than r so, by Lemma 13.21 

s,it -v)= P(o,o)(ro^'^ + T>t-v)r^ P(o,o)(r > t - v) P(o,o)(r > t) = S(o,o)(t). 
Similarly, 

I'l — U 

Sio,u)it -v)= goe"^''"'P(/?^ + T>t-v- w)dw ~ (1 - e-''"(^-"))P(i?^ + r > t) 

Jo 

and so S(o.„)(t — ^)/s(o,o)(^) converges to the desired limit. □ 

It is easy to see that h, defined by hi = 1, for z G C and /i(o,u) = ^~l_''°-lo strictly 

P- superharmonic and is harmonic on C: the following theorem then follows easily 
from a mild adaptation of Theorem 4.1.1 of [9j. 
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Theorem 3.7. Under the conditions of Theorem \3.6l the restriction of the law of X'^ 

to Ts converges vaguely to that of X°° restricted to Ts, where P°° is the (suh stochastic) 
h-transform of P (which dies from state (0, u) with hazard rate X{u) = ) . 

Example 3.8. Consider the case where Xljec 9'o.i-^i.o('^) = °o /o'^ all \ > but 
l/^ > 0. For example, we may take the nearest-neighbour random walk on N with 
up-jump rate b and down-jump rate d (with b < d) and then set 

6 

go = 1; qo,i = -r^ fort G N. 



It is well-known that 

and 

where 



Ijp = l) + d- 2VM, 
^.o(A) = 7l, 



b + d-\- J(b + d-\f-Abd 

= 2b ' 

for < A < /i'" . So, for any A > 0, J2ieN %,i^i,oW = Ee'^^ = oo and hence = 0. 

Now we consider the case where /i'" = (and hence = also). 

Theorem 3.9. Denote by t^^^ a generic random variable having the distribution of 
the T conditional on Xq = i. Suppose that r^*) have comparable heavy tails, so that 

P(r« > t) = P,(r > t) ~ QP(rW > t) = QP(o,o)(r > t) and *-=^ 1, then, 

defining 

hi = Ci, fori e S 

and 

\ _ g-9o(l--ii) 

^(0'-) = 1 _ ' 

(3.4) ^A^-^) 2i for allv>0 and for all %, j G S. 

In particular, if the 's have comparable subexponential tails, with 
¥{t^^ >t)= Pi(ro > t) ~ aiP(r^') > t) = a,Pi(ro > t) 

and 

qo,i = for i > n, 
then, defining gq = 0, m = Xljec 9o,jOj/go) 

(e'Jo — l)m 

and 

\ _ g-Qo(l-«) 

^(0'-) = 1 _ ' 

we have that 

sAt — 1-^^. Ha ^ o 
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In general a must be P-superharmonic. If a is P -harmonic then h is P -harmonic, so 
that, in this case, the restriction of the law of to Ts converges weakly to that of 
X°° restricted to Tg, where P°° is the (stochastic) h-transform of P. 

Proof. The first claim is essentially a restatement of the conditions for convergence in 

(Bai). 



To prove the second statement, first notice that we may write 



TV 



rW = ro^*) + l + ^(^" + i?-), 

n=l 

where (i7")„>i are a sequence of iid random variables with distribution that of the 
holding time in conditioned on its lying in (0,1), is a Geometric(e~'^") r.v. and 
the i?"'s are as in section 2 and all are independent. 

Now each is a mixture of Tq^'s, so, by Lemma [3.51 

P(i?- > t) = V ^P(r(S*^ > ^) ~ "E — «iP(^o'^ > ^) = ^P(^o'^ > 

Now it follows from Lemma 13.21 that {H"' + i?") is tail equivalent to and is 
subexponential and then we deduce, from Lemmas 13.31 and 13.41 that P(r^*^ > t) ~ 
{ai + m(e^o - > t) = m(e«o - l)/iiP(r^^^ > t). The last statement follows 

from the fact that X is non-explosive and it is then easy to check (by considering the 
chain at the epochs when it leaves and returns to 0) that then h is P-harmonic if a is 
P-harmonic □ 



Theorem 3.10. Suppose that X is a recurrent birth and death process on Z+ and. 



for some i, Tq*'' is subexponential, then W{tq'^ > t) ^ j-FItq'^ > t), where (3 is the 



unique P harmonic function on N with /?i = 1. 

Proof. Notice that, since Tq*'* is subexponential, it follows that /i*" = and hence, by 
Theorem 5.1.1 of [10], there is a unique P- harmonic (3. It follows that for any n, (T„, 
the first exit time of X from the set {1, . . . , n — 1} has an exponential tail (i.e its tail 
decreases to at an exponential rate) and the exit is to n with probability (3i/ (3n if X 
starts in i. 



It follows that for each j < i, 



(r(^-) > t) ~ |p(r« > t). 



Similarly, for i < n, Tq^ = an + IaTq"'', where A ={X exits {1, . . . ,n — 1} to n), so 
that 

F{t^^ > t) ~ P(A)P(r^") >t) = ^n^t^ > t)- 

□ 

The following is an immediate consequence of Theorems 13.91 and 13.101 

Corollary 3.11. If X is a birth and death process on Z+ and, for some i, t^^ is 
subexponential, and for some n, qoj = for j > n then the conclusion of Theorem 
El holds. 
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Remark 3.12. // /i*^ = and the process conditioned on not hitting until time T 
converges vaguely, then the Tq*"* 's must have comparable heavy tails. If, in fact the 
convergence is weak (i.e. to an honest process) then the vector a must be harmonic 
for P. 

Remark 3.13. Suppose that X is a birth and death process, with birth rates hi equal 
to the corresponding death rates. If the rates are decreasing in i, then Tq^'* is subexpo- 
nential. 

To see this, first observe that, by conditioning on the first jump, we obtain that 

P(r(^^ >t) = ip(Ei > t) + ^nEi + r!f^ > t), 
where Ei is the first waiting time in state 1 . Now, since 

^(2) _ ^(2) (1) 

and since stochastically dominates tI^\ we obtain the desired result that 



F(^)(t) 
limsup < 2, 

t-.oo F{t) ~ 

where F is the distribution function of The result now follows by l{3.2\) . 

4. Some concluding remarks 



Sigman [18] gives some conditions which ensure that a random variable has a subex- 
ponential tail. 

Many obvious examples exist of the a-recurrent case. We have exhibited a few exam- 
ples in the a-transient case always assuming that C is irreducible. If it is not, then in 
principle we can divide C into communicating classes {C; : / G L}, where L is some 
countable or finite index set. It is easy to show that 



< inf u 



Ci 



By adapting the proof of Theorem 13. 6[ it is easy to see that if r is subexponential 
but fi^' > for some / G L, then 1 for i,j G Q U {{0} x [0, 1) and so, 



as in Theorem 13. 7[ weak convergence of the conditioned chains is not possible if each 
u*"' > 0. Conversely, if minu'"' = u'"'* and X restricted to Ci* is a-recurrent then 

(j) = [Jp^' and a suitably adapted version of Theorem 11.21 and Corollary 11.41 will apply. 
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